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DETAILED ACTION 

This communication is responsive to the Request for Continued Examination filed 
1/27/2010. Claims 1-11 and 24 have been previously cancelled. Claims 12-16, 18, 20 
and 23 have been amended. Claims 12-23 are pending. 

Claim Rejections - 35 USC § 103 

The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

Claims 12-23 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Ghercioiu et al. (US 2004/0010734) in view of Hasako et al. (US 2003/0093715), and 
further in view of Keele et al. (US 2005/0086695). 

In reference to claim 12, Ghercioiu teaches a display apparatus comprising 
(Ghercioiu, pg. 1, par. 10): 

storage means for storing a control program having a plurality of instructions and 
symbol data for displaying a plurality of symbols related to each of said plurality of 
instructions (Ghercioiu, pg. 14, par. 233); 
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control means for controlling control target equipment electrically connected to 
said display apparatus by executing each of said plurality of instructions (Ghercioiu, pg. 
1, par. 7); 

display means for displaying an image (Ghercioiu, pg. 2, par. 12); 

first display control means based on the symbol data corresponding to the 
instructions executed by said control means for causing the symbols corresponding to 
said executed instructions to be displayed in a first display region in said display means 
(Ghercioiu, pg. 1, par. 7); 

video signal input means for receiving an input of video data generated based on 
a picked-up image of said control target equipment for each of the instructions 
(Ghercioiu, pg. 7, par. 80); 

video data storing means for storing said video data (Ghercioiu, pg. 7, par. 80); 

detection means for detecting designation of a symbol associated with a signal 
indicating abnormality of the control target equipment among the plurality of symbols 
displayed in said first display region (Ghercioiu, pg. 7, par. 82; pg. 14-15, par. 240; pg. 
15, par. 242). 

Ghercioiu however fails to teach a relation means for relating the symbol data 
corresponding to the instructions executed by said control means to the video data 
stored in said video data storing means; and second display control means responsive 
to detection of said designation for causing a moving image to be displayed in a second 
display region in said display means based on the video data related to the symbol data 
corresponding to the symbol displayed in said first display region. 
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Hasako discloses a display apparatus, analogous in art with that of Ghercioiu, 
comprising a relation means for relating the symbol data corresponding to the 
instructions executed by said control means to the video data stored in said video data 
storing means (Hasako, pg. 1, par. 15-17; pg. 17, par. 376); 

and second display control means responsive to detection of said designation for 
causing a moving image to be displayed in a second display region in said display 
means based on the video data related to the symbol data corresponding to the symbol 
displayed in said first display region (Hasako, Fig. 13a; pg. 17, par. 376). 

At the time the invention was made it would have been obvious to one having 
ordinary skill in the art to modify the display apparatus of Ghercioiu such that there is a 
relation means for relating the symbol data corresponding to the instructions executed 
by said control means to the video data stored in said video data storing means; and 
second display control means responsive to detection of said designation for causing a 
moving image to be displayed in a second display region in said display means based 
on the video data related to the symbol data corresponding to the symbol displayed in 
said first display region, as taught by Hasako. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to carry out inspection and troubleshooting of a process in 
sync with a displayed video image of the process. 

Ghercioiu modified by Hasako however fails to teach wherein the control means 
displays the moving image of at least one of a time period from a predetermined time 
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previous to said detection and a time period to a predetermined time after said 
detection. 

Keele discloses a display system comprising event detection, analogous in art 
with that of Ghercioiu modified by Hasako, wherein the control means displays the 
moving image of at least one of a time period from a predetermined time previous to 
said detection and a time period to a predetermined time after said detection (Keele, pg. 
10, par. 143). 

At the time the invention was made it would have been obvious to one of ordinary 
skill in the art to combine the display apparatus of Ghercioiu modified by Hasako 
wherein the control means displays the moving image of at least one of a time period 
from a predetermined time previous to said detection and a time period to a 
predetermined time after said detection, as taught by Keele. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to enable the user to focus in on a particular time period for 
analysis or troubleshooting. 

Claim 13 is rejected as being dependent on rejected claim 12 as discussed 
above and further, Ghercioiu fails to teach further comprising: timer means for 
measuring a time, wherein said relation means relates the symbol data corresponding 
to the symbols displayed in said first display region to the video data input through said 
video signal input means based on the time measured by said timer means. 



Application/Control Number: 10/586,131 Page 6 

Art Unit: 2629 

Hasako discloses a display apparatus, analogous in art with that of Ghercioiu, 
further comprising timer means for measuring a time, wherein said relation means 
relates the symbol data corresponding to the symbols displayed in said first display 
region to the video data input through said video signal input means based on the time 
measured by said timer means (Hasako, pg. 17, par. 397-399). 

At the time the invention was made it would have been obvious to one having 
ordinary skill in the art to modify the display apparatus of Ghercioiu such that it further 
comprises timer means for measuring a time, wherein said relation means relates the 
symbol data corresponding to the symbols displayed in said first display region to the 
video data input through said video signal input means based on the time measured by 
said timer means, as taught by Hasako. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to carry out inspection and troubleshooting of a process in 
sync with a displayed video image of the process. 

Claim 14 is rejected as being dependent on rejected claim 13 as discussed 
above and further, Ghercioiu as modified by Hasako teaches further comprising: state 
signal input means for receiving an input of a state signal indicating a state of said 
control target equipment (Ghercioiu, pg. 14, par. 233); 

log generation means for generating log information representing history of an 
operation of said control target equipment based on said time and said state signal 
(Ghercioiu, pg. 14, par. 233); 
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and log storing means for storing said log information (Ghercioiu, pg. 14, par. 

233), 

wherein said relation means relates the symbol data corresponding to the 
symbols displayed in said first display region to said log information (Hasako, pg. 17, 
par. 397-399). 

Claim 15 is rejected as being dependent on rejected claim 14 as discussed 
above and further, Ghercioiu modified by Hasako teaches wherein said state signal 
input means receives an input of said signal indicating an abnormality in said control 
target equipment (Ghercioiu, pg. 14, par. 233); 

said log generation means generates log information indicating an abnormality in 
said control target equipment when said signal indicating an abnormality is input 
(Ghercioiu, pg. 14, par. 233); 

said relation means relates a time at which said log information indicating an 
abnormality is generated to said log information indicating an abnormality for storage in 
said log storing means (Hasako, Fig. 13a; pg. 17, par. 376), 

and said first display control means causes the symbols to be displayed in said 
first display region by making a difference between an output form of the symbol data 
for displaying the symbols corresponding to said log information indicating an 
abnormality and an output form of the symbol data for displaying the symbols 
corresponding to a normal state in said control target equipment, so that a first display 
manner in said display means of the symbols corresponding to said log information 
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indicating an abnormality differs from a second display manner in said display means of 
the symbols corresponding to said normal state (Ghercioiu, pg. 14, par. 233). 

Claim 16 is rejected as being dependent on rejected claim 15 as discussed 
above and further, Ghercioiu teaches wherein said detection means detects designation 
of the symbols displayed in said first display manner (Ghercioiu, pg. 14, par. 233). 

Ghercioiu however fails to teach said display apparatus further comprising: 
reading means for reading time corresponding to said log information indicating an 
abnormality from said log storing means based on detection of said designation. 

Hasako discloses a display apparatus, analogous in art with that of Ghercioiu, 
further comprising: reading means for reading time corresponding to said log 
information indicating an abnormality from said log storing means based on detection of 
said designation (Hasako, Fig. 13a; pg. 17, par. 376). 

At the time the invention was made it would have been obvious to one having 
ordinary skill in the art to modify the display apparatus of Ghercioiu such that there is a 
reading means for reading time corresponding to said log information indicating an 
abnormality from said log storing means based on detection of said designation, as 
taught by Hasako. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to carry out inspection and troubleshooting of a process in 
sync with a displayed video image of the process. 
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Ghercioiu modified by Hasako however fails to teach a reproduction means for 
reading video data corresponding to a predetermined period of time from said read time, 
wherein said second display control means causes a moving image to be displayed in 
said second display region based on the video data read by said reproduction means. 

Keele discloses a display system, analogous in art with that of Ghercioiu 
modified by Hasako, with a reproduction means for reading video data corresponding 
to a predetermined period of time from said read time (Keele, pg. 10, par. 143), 

wherein said second display control means causes a moving image to be 
displayed in said second display region based on the video data read by said 
reproduction means (Keele, Abstract; pg. 10, par. 143). 

At the time the invention was made it would have been obvious to one of ordinary 
skill in the art to combine the display apparatus of Ghercioiu modified by Hasako such 
that there is a reproduction means for reading video data corresponding to a 
predetermined period of time from said read time, wherein said second display control 
means causes a moving image to be displayed in said second display region based on 
the video data read by said reproduction means, as taught by Keele. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to enable the user to focus in on a particular time period for 
analysis or troubleshooting. 

Claim 17 is rejected as being dependent on rejected claim 16 as discussed 
above and further, Ghercioiu modified by Keele however fails to teach wherein said 
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display means displays said first display region and said second display region in the 
same screen. 

Hasako discloses a display apparatus, analogous in art with that of Ghercioiu 
modified by Keele wherein said display means displays said first display region and said 
second display region in the same screen (Hasako, Fig. 13a.). 

At the time the invention was made it would have been obvious to one having 
ordinary skill in the art to modify the display apparatus of Ghercioiu modified by Keele 
wherein said display means displays said first display region and said second display 
region in the same screen, as taught by Hasako. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to carry out inspection and troubleshooting of a process in 
sync with a displayed video image of the process. 

Claim 18 is rejected as being dependent on rejected claim 15 as discussed 
above and further Ghercioiu modified by Hasako teaches wherein said detection means 
detects designation of the symbols displayed in said first display manner (Ghercioiu, pg. 
14, par. 233), 

said display apparatus further comprising: reading means for reading time 
corresponding to said log information indicating an abnormality from said log storing 
means based on detection of said designation (Ghercioiu, pg. 14, par. 233). 

Ghercioiu modified by Hasako however fails to teach a reproduction means for 
reading video data corresponding to a period of time from predetermined time previous 
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to said time to predetermined time subsequent to said time, wherein said second 
display control means causes a moving image to be displayed in said second display 
region based on the video data read by said reproduction means. 

Keele discloses a display system, analogous in art with that of Ghercioiu 
modified by Hasako, such that there is a reproduction means for reading video data 
corresponding to a period of time from predetermined time previous to said time to 
predetermined time subsequent to said time (Keele, pg. 10, par. 143), 

wherein said second display control means causes a moving image to be 
displayed in said second display region based on the video data read by said 
reproduction means (Keele, Abstract; pg. 10, par. 143). 

At the time the invention was made it would have been obvious to one having 
ordinary skill in the art to modify the display apparatus of Ghercioiu modified by Hasako 
such that there is a reproduction means for reading video data corresponding to a 
period of time from predetermined time previous to said time to predetermined time 
subsequent to said time, wherein said second display control means causes a moving 
image to be displayed in said second display region based on the video data read by 
said reproduction means, as taught by Keele. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to enable the user to focus in on a particular time period for 
analysis or troubleshooting. 
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Claim 19 is rejected as being dependent on rejected claim 18 as discussed 
above and further, Ghercioiu modified by Keele however fails to teach wherein said 
display means displays said first display region and said second display region in the 
same screen. 

Hasako discloses a display apparatus, analogous in art with that of Ghercioiu 
modified by Keele wherein said display means displays said first display region and said 
second display region in the same screen (Hasako, Fig. 13a.). 

At the time the invention was made it would have been obvious to one having 
ordinary skill in the art to modify the display apparatus of Ghercioiu modified by Keele 
wherein said display means displays said first display region and said second display 
region in the same screen, as taught by Hasako. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to carry out inspection and troubleshooting of a process in 
sync with a displayed video image of the process. 

Claim 20 is rejected as being dependent on rejected claim 15 as discussed 
above and further, Ghercioiu modified by Hasako teaches wherein said second display 
control means (Hasako, Fig. 13a; pg. 17, par. 376), 

includes time data reading means for reading each time corresponding to each of 
said plurality of symbols from said log storing means (Ghercioiu, pg. 14, par. 233). 

Ghercioiu as modified by Hasako above does not expressly disclose video data 
reading means for reading video data corresponding to a predetermined period of time 
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from said read each time for each of said plurality of symbols from said log storing 
means. 

However, Hasako additionally teaches a display apparatus, analogous in art with 
that of Ghercioiu such that there is a reading means for reading video data 
corresponding to a predetermined period of time from said read each time for each of 
said plurality of symbols from said log storing means (Hasako, pg. 1, par. 15-17; pg. 17, 
par. 376). 

At the time the invention was made it would have been obvious to one having 
ordinary skill in the art to further modify the display apparatus of Ghercioiu in view of 
Hasako above wherein there is a reading means for reading video data corresponding 
to a predetermined period of time from said read each time for each of said plurality of 
symbols from said log storing means, as taught by Hasako. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to carry out inspection and troubleshooting of a process in 
sync with a displayed video image of the process. 

Ghercioiu as modified by Hasako does not expressly disclose a reproduction 
control means for causing a moving image to be displayed in said second display region 
in time order or backward in time from said time corresponding to any symbol of which 
said designation is detected based on said read video data. 

Keele discloses a display system, analogous in art with that of Ghercioiu 
modified by Hasako, such that there is a reproduction control means for causing a 
moving image to be displayed in said second display region in time order or backward in 
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time from said time corresponding to any symbol of which said designation is detected 
based on said read video data (Keele, pg. 10, par. 143). 

At the time the invention was made it would have been obvious to one having 
ordinary skill in the art to modify the display apparatus of Ghercioiu modified by Hasako 
such that there is a reproduction means for reading video data corresponding to a 
period of time from predetermined time previous to said time to predetermined time 
subsequent to said time, as taught by Keele. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to enable the user to focus in on a particular time period for 
analysis or troubleshooting. 

Claim 21 is rejected as being dependent on rejected claim 20 as discussed 
above and further, Ghercioiu as modified above by Hasako and further in view of Keele 
does not expressly disclose wherein said display means displays said first display 
region and said second display region in the same screen. 

However, Hasako additionally teaches a display apparatus, analogous in art with 
that of Ghercioiu in view of Keele wherein said display means displays said first display 
region and said second display region in the same screen (Hasako, Fig. 13a.). 

At the time the invention was made it would have been obvious to one having 
ordinary skill in the art to modify the display apparatus of Ghercioiu in view of Keele 
wherein said display means displays said first display region and said second display 
region in the same screen, as taught by Hasako. 
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As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to carry out inspection and troubleshooting of a process in 
sync with a displayed video image of the process. 

Claim 22 is rejected as being dependent on rejected claim 12 as discussed 
above and further, Ghercioiu modified by Hasako teaches wherein said video signal 
input means receives an input of each video data generated based on an image of said 
control target equipment picked up by each of a plurality of image picking-up means 
(Ghercioiu, pg. 7, par. 80), 

said relation means relates each symbol data corresponding to each of a plurality 
of instructions executed by said control means to said each video data and said second 
display control means causes each moving image to be displayed in said second 
display region based on said each video data (Hasako, pg. 1, par. 15-17; pg. 17, par. 
376). 

In reference to claim 23, Ghercioiu teaches a computer-readable recording 
medium storing thereon a program causing a computer to function as a display 
apparatus (Ghercioiu, pg. 14, par. 233), 

said program causing said computer to execute the steps of: reading a control 
program having a plurality of instructions and each symbol data for displaying a plurality 
of symbols related to each of said plurality of instructions from storage means for storing 
data (Ghercioiu, pg. 14, par. 233), 
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controlling control target equipment electrically connected to said computer by 
executing each of said plurality of instructions (Ghercioiu, pg. 1, par. 7); 

based on the symbol data corresponding to the instructions executed at said 
controlling step (Ghercioiu, pg. 1, par. 7); 

causing the symbols corresponding to said executed instructions to be displayed 
in a first display region in display means for displaying an image (Ghercioiu, pg. 1, par. 
7); 

receiving an input of video data generated based on a picked-up image of said 
control target equipment for each of the instructions (Ghercioiu, pg. 7, par. 80); 

storing said video data in said storage means (Ghercioiu, pg. 7, par. 80); 

detecting designation of a symbol associated with a signal indicating abnormality 
of the control target equipment among the plurality of symbols displayed in said first 
display means (Ghercioiu, pg. 7, par. 82; pg. 14-15, par. 240; pg. 15, par. 242). 

Ghercioiu however fails to teach relating the symbol data corresponding to said 
executed instructions to said video data; and in response to detection of said 
designation, causing moving images relating to the designated symbols to be displayed 
in a second display region in said display means based on the video data related to the 
symbol data corresponding to the designated symbols displayed in said first display 
region. 

Hasako discloses a display apparatus, analogous in art with that of Ghercioiu, 
relating the symbol data corresponding to said executed instructions to said video data 
(Hasako, pg. 1, par. 15-17; pg. 17, par. 376); 
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and in response to detection of said designation, causing moving images relating 
to the designated symbols to be displayed in a second display region in said display 
means based on the video data related to the symbol data corresponding to the symbol 
displayed in said first display region (Hasako, Fig. 13a; pg. 17, par. 376). 

At the time the invention was made it would have been obvious to one having 
ordinary skill in the art to modify the display apparatus of Ghercioiu such that there is a 
relation means for relating the symbol data corresponding to the instructions executed 
by said control means to the video data stored in said video data storing means; and 
second display control means responsive to detection of said designation for causing 
moving images relating to the designated symbols to be displayed in a second display 
region in said display means based on the video data related to the symbol data 
corresponding to the symbol displayed in said first display region, as taught by Hasako. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to carry out inspection and troubleshooting of a process in 
sync with a displayed video image of the process. 

Ghercioiu modified by Hasako however fails to teach wherein a display region 
displays the moving image during a period of at least one of prior to and after said 
detection. 

Keele discloses a display system comprising event detection, analogous in art 
with that of Ghercioiu modified by Hasako, wherein a display region displays the moving 
image during a period of at least one of prior to and after said detection (Keele, pg. 10, 
par. 143). 
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At the time the invention was made it would have been obvious to one of ordinary 
skill in the art to combine the display apparatus of Ghercioiu modified by Hasako 
wherein a display region displays the moving image during a period of at least one of 
prior to and after said detection, as taught by Keele. 

As one of ordinary skill in the art would appreciate, the suggestion/motivation for 
doing so would have been to enable the user to focus in on a particular time period for 
analysis or troubleshooting. 

Response to Arguments 

Applicant's arguments with respect to claims 12-23 have been considered but are 
moot in view of the new ground(s) of rejection. 

Applicant's argue on pages 9-11 of the Request for Continued Examination that 
the cited prior art of reference does not disclose or suggest the amended limitation of 
"detection means for detecting designation of a symbol associated with a signal 
indicating abnormality of the control target equipment among the plurality of symbols 
displayed in said first display region". 

Ghercioiu discloses detection means for detecting designation of a symbol 
associated with a signal indicating abnormality of the control target equipment among 
the plurality of symbols displayed in said first display region (Ghercioiu, pg. 7, par. 82; 
pg. 14-15, par. 240; pg. 15, par. 242) 

Ghercioiu teaches that the user interface portion of the graphical program may 
include various graphical user interface elements or front panel objects, such as 
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indicators, that represent or display the input and output that will be used by the 
graphical program, and that the program may display both input and output. Ghercioiu 
further teaches that a target device may send output data consisting of acquired data or 
execution results to the host system for display of the appropriate graphical user 
interface symbol, or to generate a certain result. Execution of the program results in 
data being acquired, detection means, and generated for display and analysis, and for 
data to be sent to other systems. 

Therefore, the cited art of reference teaches "detection means for detecting 
designation of a symbol associated with a signal indicating abnormality of the control 
target equipment among the plurality of symbols displayed in said first display region". 

Conclusion 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to CHARLES HICKS whose telephone number is 571-270- 
7535. The examiner can normally be reached on Monday-Thursday from 7:30 to 4:00. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Sumati Lefkowitz, can be reached on 571-272-3638. The fax phone number 
for the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
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For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 

/Sumati Lefkowitz/ 

Supervisory Patent Examiner, Art Unit 2629 



